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ABSTRACT: 

We consider a Markov chain on a countable state space, on which is placed a random 
field of traps, and ask whether the chain gets trapped almost surely. We show that the 
quenched problem (when the traps are fixed) is equivalent to the annealed problem (when 
the traps are updated each unit of time) and give a criterion for almost sure trapping versus 
positive probability of non-trapping. The hypotheses on the Markov chain are minimal, and 
in particular, our results encompass the results of den Hollander, Menshikov and Volkov 
(1995). 
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1 Introduction and statement of results 


Let 5 be a countable space and let p : S'^ [0,1] be a set of transition probabilities on 
S, i.e., '^yP{x^y) = 1 for all x ^ S. Let denote any probability measure such that the 

random sequence Xq, Xi, X 2 , ... is a Markov chain with transition probabilities {p{x,y)}, 
starting from Xq = x. Given a function q : S [0,1); representing a set of trapping 
probabilities, we define two new Markov chains as follows. 

Quenched problem, “site x is a trap with probability q{x) forever”. Let T C 5 be the 
random set of traps, i.e., ^^{{xi, ..., Xn} C T) = Y\a=i Q{xi) for all finite subsets of S, and 
T is independent of Xq, Xi, .... We are interested in the quantities 

7r(x) = Px{Xn G T for some n > 0). (1-1) 

We say that the quenched field is trapping or non-trapping, according to whether 7r(x) = 1 
for all x, or whether 7r(x) < 1 for some x. 

Annealed problem. “The state of site x is a trap with probability q{x), but each unit 
of time the state of site x is chosen afresh with this probability”. This gives us an IID 
sequence of trap sets {T„ : n > 0}, each distributed as T in the quenched problem. We let 

7r(x) = VxiXn G Tn for some n > 0). (1-2) 

We say that the annealed field is trapping or non-trapping, according to whether 7r(x) = 1 
for all X, or whether 7f(x) < 1 for some x. 

Our first result is the equivalence of these two problems. Let 

00 

9{x,y) = = y) 

n=0 

denote the Greens function. 

Theorem 1.1 Assume there is a constant K sueh that 

g{x,x) < K for all x G 5. (1-3) 
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Then the annealed field is trapping if and only if the quenched field is trapping. 


Remarks: 


The necessity of an assumption such as (1.3) is illustrated by Example 2 below. 


2. These two problems were considered by den Hollander, Menshikov and Volkov (1995) 
in the special case of mean-zero, finite-variance random walk on Z'^, d > 3. They showed (in 
their Section 5) that the quenched and annealed problems were equivalent under an addi¬ 
tional technical assumption. The present theorem thus removes their technical hypothesis, 
as well as showing that the particular setting of Z'^ is irrelevant. 


3. It is elementary (see the next paragraph) that tt{x) < 7r(x} for all x. Thus only one 


direction of Theorem 1.1 is interesting. 


Let t(x) = infj/c : = x} denote the first hitting time of the point x and define the 

two quantities 

n 

Rn = ^-log(l-g(Vi))l^(x,)=i ; (1.4) 

^=0 

n 

Rn = ^-log(l-g(Vi)). 

i=0 

It is easy to see that the probability of no trapping in the annealed chain up to time n is 
given by 

RxiXi ^ Ti for alH < n I Xq, ..., V„) = exp(-^„). 

Similarly, since the conditional probability of Xn ^ T given Xq, Xi,... and given {Xi ^ T : 
i < n}, is equal to 1 — q{Xn)'^r(Xn)=n-: the probability of no trapping in the quenched chain 
to time n may be computed as 


PxiXi ^ T for alH < n I Vq, ..., V„) = exp(-ij’„). 
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Thus 

7r(x) = E[1 — exp(—i2oo)] and (1-5) 

7f(x) = E[1 - exp(-^oo)]- 

From equations ( p^ ) and (|1.5|) , it is evident that Rn < Rn, and hence that tt{x) > 7r(x) for 
all X. 


We turn now to the determination of a criterion for trapping. We consider only the 
annealed case, which of course solves the quenched case as well under condition O)- 
By 0)> the problem rednces to the determination of when i?oo = oo with probability 1. 
Define 

n 

Sn = 

i=0 

Sn = ^qiX,) 
i=0 

and observe that i?oo = oo if and only if S' = oo, and that Roc = oo if and only if Soo = oo. 
Thus an obvious necessary condition for trapping in the anealed case is that for all xq, 


ESoo = ^ g{xo,x)q{x) = oo. 

xOS 


( 1 . 6 ) 


Later, we will discuss some conditions under which this is snfhcient as well, but the next 
example shows that (1.6) is not always sufficient for trapping. 


Definition 1 Say that a subset A C S is transient for x ifPxiXn G A for some n) < 1. Say 
that A is transient if it is transient for some x. We remark that when all states communicate 
in A'^, then A must be transient for all x or for no x; with the present definition, our results 
make sense for more general chains. 


Example 1: Let A be any transient set satisfying example of 

such a set A for simple random walk in is the set 

{x : I |x — (0,0, 2"') 11 < 2""/^ for some n > 1}. 
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Let q{x) = c G (0,1) for x G A and 0 for x ^ A. Then clearly 7r(xo) < 1, while 
Exe 5 5(0,x)g(x) = oo. 

Our second result is that this is the only way that o can fail to imply trapping. 

Theorem 1.2 Suppose that the annealed field is non-trapping, i.e., for some xq, 7r(xo) < 1. 
Then there exists a subset ^ C 5 such that 

(i) A is transient for Xq, and 

i'ii) 9{xo,x)q{x) < oo. 

x£S\A 

These two theorems are proved in Section 2. The final section discusses conditions under 
which the condition J2xeS 9 ixojx)q{x) = oo is necessary and sufficient for trapping. These 
cases include the case of a simple random walk on Z'^, d > 3, and a spherically symmetric 
function q(x) = gdlxH) discussed in den Hollander, Menshikov and Volkov (1995). 


2 Proofs of the two theorems 

Proof of Theorem |1.1| : By (|L^), it suffices to show that the event {5oo < oo = 5oo} has 
probability zero. Recall that t(x) is defined to be the first hitting time of x, and let J - r { x ) 
be the cr-field generated by the Markov chain up to time t(x). Observe that for any x and 
any event G G iFT{x)y 

OO 

ExolGlr(a:)<oo(X!lv=a^) =5'(a^,a:)P,j,o(Gn{T(x) <oo}). (2.1) 

1=0 

Given M > 0, define a time tm = inf{fc ■ > M} and define 

oo 

i=0 
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From the definitions, it is evident that = Soo whenever tm = oo. A second useful 
fact, also immediate from the definitions, is that the event {t(x) < tm} is the same as the 
intersection of events 

{t(x) < 00} n < M}, 

from which also we see it is in ■ From these two facts we get 

CXD 

i=0 x£S 

00 

'y ' g(x)E ^ lXi=x^T(x)<oo'^S^i^\_^ <M■ 

x£S i=0 

for each x shows that this is equal to 

a;)Pa;o (t(x) < 00, < M ), 

x£S 

which is bounded above by 

Kq{x)Pxo{T{x) < tm) = KE^^Sr^ ■ 

xGS 

Since < M + 1, this shows that for any M, has hnite expectation and is hence 

almost surely hnite. Since = Soo whenever tm = 00, we see that Soo < 00 whenever 
Tm = 00 for some M, which happens exactly when S'oo <00. □ 


Applying (2.1 


Before proving Theorem 1.2, we give an example to show that the hypothesis of a 
bounded Greens function is necessary. 


Example 2: Let S = {2,3,4...} with transition probabilities p{n,n + 1) = 1/n, 
p{n,n) = 1 — 1/n and p{n,k) = 0 for k ^ n,n + 1. The quenched held traps the chain 
at n with probability q{n), conditional on its not being trapped at any k < n, hence the 
quenched held is trapping if and only if J2n 9(^) = o®- "^^6 annealed held traps the chain at 
n with probability nq/{nq + 1 — q), conditional on its not being trapped at any k < n, hence 
the annealed held is trapping if and only if J2n nq{n) = 00 , which is the Greens function 
criterion. 


5 




One can replace this example if desired by an example where the Markov chain is a 
simple random walk. Let G be a binary tree, rooted at a vertex 0, to which is appended at 
each vertex v in generation n > 0 a single chain of vertices of length n. Setting q{x) = 1/n 
if X is the end of one of these chains for some n, and q{x) = 0 otherwise, makes the annealed 
field trapping and the quenched field non-trapping for simple random walk. 

We now give the proof of Theorem |1.2| . The idea is that if (X^) is a martingale if one stops 
at the value 1 upon being trapped, and therefore that 7f(X„) is a Pj,-supermartingale. The 
excess of a positive superharmonic function (ff) is integrable against the Greens function; 
this excess is usually close to q, and in fact the set where the excess of if is not near q must 
be a transient set. We begin by stating two facts whose proofs are immediate. 

Lemma 2.1 For all x, under no assumptions on the Markov chain, 

7t(x) = q(x) + (1 - g'(x))Ej,7f(Xi). 


□ 


Proof of Theorem Let Ba = {x : if(x) > a}. Observe that if 

^ ^ -^1/16 ^ Ea;(Xi G B 1 / 4 ) < 


( 2 . 2 ) 


For any a, the set Ba is the union of a finite set and a set transient for xq. To see this, note 
that if(X„) —> 0 almost surely on the event of nontrapping, and hence that P3;p(7f(X„) —> 
0) > 0; choosing N so that Pa,p(if(X„) < aVn > N) > 0, and letting F = {xi,X2, ■ ■ ■ ,xjv} 
such that 

Pxoi^i^n) < flVn > N \ Xi = Xi ioT i = 1,... N) > 0, 


gives a set Ba\F that is transient for xq. We now show that x)Qix) < 00 , 

which proves the theorem with A = Si/ig \ F. By (^), for any x ^ 

Ea;if(Xi) < —Pa;(Xi ^ B1/4) + Pa;(Xi G B1/4) < — . 
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Applying Lemma 2.1 we see that for any x, 


E2;7f(Ai) = 7r(x) - g'(x)(l - Ea;7f(Ai)) 

< n{x) - . 

Iterating this, using the Markov property, gives 

n—1 2 

0 < E^7r{Xn) < vf(x) - -E^q{Xi)lxi^Bin6 

i=0 ^ 

and hence 

OO 

Y'^xoqixi)lxitBi;ie ^ 2fi(xo) < OO. 
i=0 

But 

CO 

Y'^xoqixi)lxi^BiBe = 9ixo,x)q{x), 

i=0 x&S\Bi/iQ 

SO this concludes the proof. 


□ . 


3 Chains with well behaved Greens function geometry 


We have not yet imposed any geometry on 5. In order to formulate regularity conditions 
under which ( |1.6| ) is equivalent to trapping, the geometry inherent in the Greens function 
must be reasonable, and must be compatible with the geometry imposed by q. Assume 
throughout this section that the Greens function bound (O) holds. 


Definition 2 For xq & S, L < K and a G (0,1), define the Greens function annulus 
Ha{L,xo) to be the set 

{x € S : L > g{xo,x) > aL}. 


Say that the Markov chain has reasonable annuli if for some a G (0,1) and for every 
L < K, xq € S and ACS transient with respect to xq, the annulus Ha{L,xo) has finite 
cardinality and 


lim sup 
L^o 


Ha{L,xo) n A\ 

\HaiL,xo)\ 


< 1 . 


(3.1) 
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Most nice chains satisfy this definition. For example, consider a simple random walk in 
Z'^, d > 3. Annuli for this chain are spherical shells, and any set A taking up more than a 
fraction (3 of such a shell is hit with probability at least f3 + o(l). Thus the probability of 
hitting A infinitely often is at least the limsup in (3.1), which is less than 1 for a transient 
set (actually 0, by tail triviality). For another example, take the Markov chain on an 
infinite rooted binary tree which always walks away from the root, choosing either of the 
two children with equal probability. This chain is far from irreducible, yet when a is large 
enough so that the annuli are nonempty, it clearly satisfies O- 


Theorem 3.1 Suppose the Markov chain on S with transitions p{x,y) has reasonable an¬ 
nuli, and suppose that, for some C, C > 1, the function (7 : 5 —> [ 0 , 1 ) satisfies the following 
regularity condition: 


^ 9 {xo,x) < g{xo,y) < Cg{xo,x) ^,q{x) < q{y) < C'q{x). 
Then 7r(xo) = 1 if and only ifJ2x9i^o^^)Qi^) — 


(3.2) 


Proof: If 7t(xo) < 1, then Theorem |1.2| gives a set A, transient for xq, with 

9 {xo,x)q{x) < 00 . 

xgS\A 


By the assumption of reasonable annuli, the transience of A and condition (3.2), 

9 {xo,x)q{x) 

x&Ha{La’^ ,xo)nA 


lim sup 

n—^oo 


9 {xo,x)q{x) 

x^Ha(La" ,xo)\A 


< 00 , 


and hence J2x 9 ixo,x)q{x) < 00 . 
Remarks: 


□ 


4. In the case of a simple random walk on we find that condition (^) is equivalent 
to the existence of a C < 1 for which 

q{x) 


sup sup 


^ J/:C'“l|3;|<|j/|<C|a:| 9(l/j 


< 00. 







This is a more natural formulation than the equivalent condition (4.1) in den Hollander, 
Menshikov and Volkov (1995), namely that 


Qix) ^ 

sup sup —— < oo. 
^ y-\y\<Vd\^\ 


Hence our Theorem 3.1 generalizes their integrability test at the end of their Section 4.1. 


5. Condition (3.1) may appear cumbersome but it is more natural than it looks. First, 


it is a condition on the Markov chain alone, so that Theorem 3.1 identifies a class of chains 
such that the x)q{x) = oo is a sharp criterion for all functions q that are “spherically 

symmetric up to constant factor” as defined by (|3.2|). Secondly, it is nearly sharp, meaning 


that if 

|H„(La-,xo)nH| _ 

™ \H^{La^,xo)\ 

then one can always choose a sequence {a„,} such that setting q{x) = on Ha{Ld^, xq) 
gives a non-trapping field for which X) g{xQ-,x)q{x) = oo. 
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